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ABSTRACT 



A review is made of that literature which focuses on 



the relationship of instructional method^ internal cognitive activity 
and performance measures. This includes literature concerned with the 
issue of "discovery versus reception learning" and the effects of 
different instructional methods on retention^ delayed retention and 
transfer tasks. The author concludes from this review that little 
progress will be made concerning our understanding of the role of 
instructional method until the emphasis on "which method is best" 
gives way to an attempt to define and relate to one another, external 
features of instruction^ internal features of subject character and 
activity during learning, and outcome performance variables. (JP) 
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The Problem 

Suppose you wanted to teach someone to solve problems of a given 
class. What kind and how much direction should be given during the 
learning process? Or suppose someone has been taught to solve problems 
of a given class. Does the teaching method that was used influence the 
learning outcome? 

These sorts of questions represent the core of what could be 
called **the instructional method problem'' the problem of ascertaining 
the relati "^nship between certain aspect*: of the instructicn^Tl ni'^ihcc^ 
(Ihc iiiuepundenl variable) and subsequent pertorniance on related or 
identical tasks (the dependent variable), Shulman (1968, p, 34) sum- 
marized the problem as follows: "The controversy seems to center es- 
sentially about the question of how much and what kind of guidance ought 
to be provided in the learning situation." 

This is not a new problem and there have been many atteir.pts to 
deal with it. However, as Wittrock (1966, p* 33) pointed out in a 
recent review of the evidence concerning the ambiguous "learning by dis- 
covery" method: "Many strong claims for learning by discovery arc made 
in educational psychology. But almost none of these claims has been 
empirically substantiated or even clearly tested in an experiment." 

The Background 

Before discussing how such claims could be tested cxperinonially , 
some background will be presented to demonstrate some distinctions in- 
volved in the claims. Though often poorly and inconsistently defined, 

a basic di:>tincl:ion between (<Jt least) two diiforent types of te/^chin^, 
m';:'?liC'l'.^ ha:; long been a coiripoiicnt of theories of i.j;iitruction. 
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The gestalt psychologists distinguished a type of instruction 
that fostered "structural understanding" from instruction that involved 
"rote iTiemory" (Wertheijner, 1959), "meaningful apprehension of relations" 
from "senseless drill and arbitrary associations" (Katona, 1940), 
"insight" from "trial and error" (Kohler, 1959), or "productive" from 
"reproductive" reasoning (Maier, 1933; Wertheimer, 1959). Unfortunately, 
however, the gestaltists never clarified their various distinctions, 
often confused differences in instructional method with differences in 
the subsequent problem solving approach, and provided little or questionable 
entpirical 5^u::>port for their claims. 

The flavor of their distinction can be found in an example by 
Wertheimer (1959) suggesting two methods of teaching to find the area 
of a parallelogram. One method emphasises the geometric or structural 
prcperty that the triangle on one end of the figure could be placed on 
the other end of the figure thus forming a rectangle (see, below): 




The other method emphasizes a sort of cook -book recipe of steps to cal-- 
culate the area, namely drop the perpendicular and multiply its height 
times the length of the base (see below): 

/ ^ ^ ' ^ ^ 

Although Ss taught under both methods should perform equally well 
on criterion tasks involving finding the area of parallelograms like the 
ones they were taught about, Wertheimer reported the Ss differed in their 
ability to transfer whau tlicy learned to new task:>. For example, the Ss 
who learned "by understanding" (the first method) should be able to find 
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the area of unusual parallelograms and shapes, e.g. 




and recognize uncalculable situations, e.g. 




while the Ss who learned in a mechanical way (the' second method) would 
say, "We haven't had this yet." 

In an example of memorizing digit strings, Katona (1940) claimed 
thac it:aiiAj.ng by "underscaauing the btxucturul reiationsftips" not oniy 
improves £'s ability to transfer but also improves £'5 ability to retain 
information over time. One group learned the digit string, 581215192226, 
by understanding the structural pattern of "add 3, add 4" as indicated 
below. 




while another group leamed by "rote memorization" of the string organized 
as 5 81-215-192-226. Although both groups performed equally well on 
criterion tests of immediate retention, Katona reported that the first 
group remembered the string longer. 

In more i^ecent years, the distinction has taken the equally am- 
biguous form of a separation between "discovery" and "expository" methods 
of instruction. Bruner (1961, 1963a, 1968) has been a major proponent 
of the discovery method. Although often describing discovery both as an 
instructional method and as a desired outcome of learning, and although 
seldom eiapirically defining either, Bruner's preferred method of instruction 
is, at least, exemplified in a procedure proposed by Dienes (see Shulman, 
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Dien^s' method of teaching children the concept of the quadratic 
equation involved allowing to manipulate the shapes, 

' D- Q' 
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in such a way that could see that the area of a square with sides of 

2 2 
length X was x , of sides (x + 1) was x + x+ x+ l,of sides 



(x + 2) was 
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The discovery method shares with the Gestalt '^learning by understanding** 
the promise cf superior transfer and retention performance by the learner. 

On the other hand, Gagn^ and his associates (Gagn6, 1968: Gagn6, 
Mayor, Carstens 5 Paradise, 1962) liave been major proponeiits of a more 
expository method often called "guided discovery'*. The method involves 
a clear and behavioral ly defined statement of the instructional objective 
and a hiex^archical enumeration of what needs to know in order to have 
the defined capability, as represented in a ^'knowledge hierarchy'* below: 




!HJ 

The prerequisite concepts, principles, definitions, etc., must be hier- 
archically defined such that in order to perform the required "capability**, 
must know A and B ; in order to know A ^ must know C and ^ ; in 

order to kiiov; C , ^ rvuL^t l-.now il ; and :;o on, Tcr.chinp then irivolves 
systcn-atical iy prosentinj; v/itl: prereciuisi to knov;led;;c , be{;ini:i :ig at the 
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lowci'.t Icvci of S's incompetence and building up. 

As Shulman (1968) pointed out, Briiner*s emphasis is on the process 
of learning while Gagn6's emphasis is on the product of learning, Bruner's 
method stresses the acquisition of a general ability to discover problem 
solutions while Gagne's method is more closely tied to specific capabilities 
in dealing with specified subject-matter, Bruner's method tends to force 
errors and subsequent "restructuring" by S while Gagn6's programmed in- 
struction presents a smooth, systematic hierarchy of knowledge thus mini- 
mizing the chances of error. 

7]ig^ Analys '■ 

As can be seen from this representative array of largely untested 
examples and claims, the following are needed: (1) a clear definition of 
the external features of the instructional methods, (2) an understanding 
of Ss internal activity during learning, (3) a set of observable per- 
formance measures for learning and learning outcomes, (4) an experimental 
procedure for determining the relationship among these variables, 
fcixtei^nal dimensions : Many methodological problems stem from unsatisfactory 
definitions of the independent (instructional) variables. As Wittrock 
(1966, p. 42) pointed out, many studies conceptually confuse, for example, 
"discovery as a way to learn" (i.e., as an independent variable) and "dis- 
covery as an end in its own right" (i.e., as a dependent variable), or 
label external instructional variables (independent variables) in terms 
of the internal responses or behavior such methods are thought to evoke 
(dependent variable). 

All too often, inadequate definitions have accompanied not only a 
con£u:iing of iiulependent variable and depender.t variable, but also a lumping 
togeth^^r of several variables into ono. The often cited discovery-expository 
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dichotomy e.s the instructional variable is actually a family of vai^iables 
and any serious attempt to investigate instructional method effects should 
recognize the various variable dimensions involved. 

Although sometimes only implicitly defined as such, the main in- 
structional variables have been: (1) amount and type of direction , e,g., 
ranging from no guidance as to how to solve representative exariiples up to 
explicit enumeration of the correct solutions, (2) sequencing of direct ion^ 
e.g., ranging from inductive example-rule procedures to deductive rule- 
example procedures, (3) continuity or structuring of direction , eg,, 
ranging fror highly discontinuous, unstrc/^tured procedures that encour^qe 
errors to smooth, Jiierarchicaiiy arranged methous Ihal miniiuiiiC tlie chai'iccs 
of subject error, and (4) control of direction , e.g., ranging from total 
subject control over the rate and order of presentation (as attempted by 
"adaptive teaching systems*') to total ex])eriipenter control. 

In a I'ecent review, Hermain) (1969) separated the amount of direction 
(e.g., discovery, vs . reception) froiii the sequencing of direction (e.g., 
inductive vs. deductive) and represented the various variables in a 2 x 2 
matrix, as shown. 

Discovery Reception 
Inductive A B 

Deductive C D 

The discovery- reception dimension is defined in terms of the air;ount 

of direction with the discovery methods involving minimum direction in 

which "...the principle content of what is to be learned is not given..." 

and the reception method involving maximum direction in which "...the 

entire content of v;hat is to be learned is presented to the leai^ner in 

final iorm,,/'. wii-trock ti'^^-^) has further ^n.ily^.od the diLicnslon taking 

into account iiot only tlie amount, but also the hind of inforiTjjtion given 
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(or not given), 'ihe amount of ijiforjuation abou/. the final answer can be 
varied (e.g., from none to detailed presentation of the ansiver in final 
form); similarly, the amount of information about the nxthod or principle 
used for solution can be varied (e.g., from none to hints or outright 
presentation of the solution method) • 

'ITie inductive-deductive dimension is defined in tcirrus of the 
sequencing of direction with deductive methods invojviii^ a direct state- 
ment of the to-be- learned rule or principle follcr/od by example applica- 
tions for to try or as Glaser (1966, p, 15) put it, ",..a teaching 
sequence in v/hich a rule is presented br-^ore exemplars or instances -jf 
the rule.,.'* and inductive methods involving the re. s.rse ordering. 
Hermann (1961)) pointed out that in terms of the existinf; resenrch litera- 
ture, cell C of his matrix is empty. 

The third dimension was discussed by Gla.si:r (1906) as a distinction 
between smoothly ^^uided teaching programs, sucli as Gat^nd's (196^0 "leainiing 
hierarchy" model, based on the principle of "error mi nirrizatioa" and more 
unstructured, discontinuous procedures such as Dtn'is' (19S8, 1966) "tor- 
pedoing" techniques which increase the chances of S_ co?r./nitting errors in 
learning. From the standpoint of "reinforcement t/icozy" Skinner (19S8) 
distinguished between teaching by "small steps" betv/eon adjacent items 
and teaching by "large steps" between adjacent items v;ith the former 
supposed to elicit far fewer errors, hence more reinforcement in learning. 

Finally, the fourth dimension involving control of direction has 
been mentioned by several investigators (e.g., Wittrock, 1966; Bruner, 
1961) and is defined in terms of the nuvuber and kinds of constraints put 

on S*5 access to tlic learning matcrirOs. 

i& — 

I nternal di r;cnsi\^ns : In contrnst to tliOi'.c cxtcvi.: 1 ' vicjr^ior.r. of the 
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instructional method, there are certain internal or intervening dimensions 
of the learner which should be considcired. The internal dimensions can 
be separated into;(l) the level of various learner characteristics established 
prior to learning, and (2) the amount and kind of cognitive activity evoked 
during learning. 

The first set of internal dimensions, whicli acts as an independent 
variable, is that of learner characteristics. Several researcher? (e.g., 
Cronback and Snow, 1969; Tallmsdge and Shearer, 1971) have reviewed and 
investigated the often contradictory role of such individual difference 
factors as ir.'^elligcuce ^ ability, extjerifi.re . personality, anxiety, age, 
sex, motivation and others. Also, there exists a classical gestalt litera- 
ture (e.g., Duncker, 1945; Luchins, 1942; Saugstad and Raahiem, 1960; Birch 
and Rabinowitz, 1931) on the importance of past experience in learning 
to solve problems* Because the individual differences literature repre- 
sents a large, fairly self-contained area, it will not be specifically 
reviewed herein. 

The second important set of internal dimensions, one which should 
properly be viewed as a dependent variable, is S_'s activity, especially 
S*s cognitive activity during learning. Kothkopf (1970) wrote of the 
influence of instructional i^iCthod on S^'s "mathcmagcnic activities" during 
learning, activities wliich he related to such concepts as set, attention, 
orienting reflex, information processing, cognition and rehearsal. Roth- 
kopf (p. 325) argued: '*The proposition is simple. In most instructional 
situations, what is learned depends largely on the activities of the student.*' 

GagncJ (1958, 1966, 1969) has outlined a series of "internal conditions 
for problon sC'lviTi;>'' v;hich include "se?:rch nnd sf^lection" of existing knowledge. 
He has sup^j/ftstuci ui-.at "wiu'M is )earnc;d" involves both "oxtcrnal events" such 
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as instructional materials, instructions, and direction, and "internal 
events" such as the nature of this "trial and error", "hypothesis selection", 
or "search and selection" activity^ 

Arguing from a somewhat different approach, Ausubel (1961, 1964, 
•1968) wrote of "learning set" and suggested that learning outcomes 
are determined both by "content conditions" (i.e., presentation of the to- 
be-leamed material) and "set conditions" (i.e., the existing cognitive 
structures £ uses to assimilate the content). Ausubel proposed that 
may store content material in either a rote or meaningful way depending 
on S's ability to relate subject matter content to existing cognitive 
structures, i.e., dept^nuxj^g oii whetliei: tlio "content" is encoued into a 
"rote learning set" or into a wider "meaningful learning set". T\\q point 
is summarized as follows (1961, p. 95): "As long as the set and content 
conditions of meaningful learning are satisfied, the outcome should be 
meaningful and the advantages of meaningful learning (economy of learning 
effort, more stable retention and greater transferability) should accrue 
irrespective of whether the content to be internalized is presented or dis- 
covered, verbal or nonverbal." 

Another argument for separating external and internal dimensions 
comes from Bruner and his associates (Bruner, Goodnow and. Austin, 1956) 
who have demonstrated the importance of S^'s "strategy" in CI tasks and 
have shown that differences in this internal encoding process are evident 
ip transfer performance. The nature of the internal search and selection 
process is at the crux of Bruner's (1966) "compatibility problem" "the 
problem of how to get a new piece of knowledge connected with an established 
domain." 

Scandura (190G, 3.^^67) hps attempted to delineate cxpcrimontnl varia- 
bles influencing how broadly S encodes mathematical rules or algorithms. 
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For cxar.plc, in :j prL;:'io:ii r.olving task, Ss given tlie solution algorithm 
in conjimction with \'c;.y ^^.pccific applications performed significant ly 
better on near tranr. T -r .itv-,.:i-. than Ss not given the algorithm, but per- 
forated signif iCuiJitly •;r/j:^:.c on far transfer than Ss given the algorithm 
with more gencvcvi cp;>l j t;ut3 ons . In another study, Ss learning problem 
solution rules in syn'>olic notation could apply them just as well as 
S^s learning the iM-tr.c rules in plain English, only if they had received 
pretraining in v.lM-t. v.i.c syr;ibols meant. The evidence supports the claim 
that although all £.'> Icarri the sa:nc content (i,e,, problem solving rules), 
interna] f::t.Lor£ 5-uch =::> 2 brc::dc** assi;;;i ■ oti vc "sct'^do influence trans- 
fer perf origan , 

Accordinv; to P./iigi^c^id and Scandura (1968, p, 288) "what is learned" 
due to these broader cognitive sets is "derivation rules" "rules for 
deriving a class of r^:vrc specific rules". Simon and Simon (1962, p, 429) 
presented cviod^cv fc . • tlio ^cui.e sort of learning outcome differences due 
to internal "tri::l c-hd crrov'* activity during S*s learning to play chess: 
•The evidence st:;o)i^;l;, :..\^ccczr> that expert chess players discover com- 
binations bcca\isc th r nr;>[',rarus incorporate powerful selective heuristics 
and not because tlioy -i.ink faster or nieraorize better t. other people," 

One posriibio r ::-^ Lvm\ou of tJie separation of external (instructional) 
Viiriablcs from ijrtci.. .i (r.c'c) variables is that different methods of in- 
struction could evok^ dirrcicnt internal sets or activities in S and hence 
different learniiig oulcones, ihe point was summarized by Mayer and Greeno 
(1972, p. ]6S): " , . , di r lorott instructional procedures could activate dif- 
ferent aspects of cxi-»tinv; cognitive structure. And since the outcome of 
Icr.rjnr.;.. ;s jc;r.!-;- . -1 by j/t.;' i;,atorial and the structure to which 

it ill :'^:.i:';.iaL , ,; difft-./rfit proc-cdurcs coujt-l lead to v.hc develop- 
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mcnt of marked ly different structures duririg the learning of the same 
new concept/' 

A crucial question at this point becomes: How can the internal 
cognitive set and activities of the learner be characterized? A number 
of defining factors have been noted with respect to these internal events 
during leax^ning, and generally the distinctions among various tj'pes of 
internal activity during learning involve: (1) actively participates 
in the discovery of the to-be-learned principle or material vs. S passively 
receives the material in final form, (2) £ stores and organizes the material 
in his own way vs. stores and organizes the material as E has organized 
it. (3) S assiiiiilates the material to a wide range of existing cognitive 
structures vs. accomodates his existing structures to the material, (4) 
S strives to acquire a high level general rule or strategy vs. strives 
to acquire discrete, specific responses to specific situations. 

Bruner (1961, p. 24) in his classic paper entitled "The act of 

discovery" discussed these distinctions between types of internal events 

during learning, especially the first one: 

Very generally, and at tlie risk of oversimplification, it is 
useful to distinguish two kinds of teaching: that which takes 
place in the expository mode and that which takes place in the 
hypothetical mode . In the former, the decisions concerning 
mode and pace and style of exposition are principally determined 
by the teacher as expositor, the student as listener. .. in ^he hy- 
pothetical mode the student is in a more cooperative position... 
the student is not a bencli-bound listener, but is taking part in 
the formulation. . .and may even take an 'as if attitude. 

Tlie second distinction between internal activities is reflected 
in Bower's (1970) separation betv;een "experimenter- imposed groupings" 
(K-^codes) and "subject-imposed groupings" (S-codes). The assimilation- 
accomodation distinction (i.e., the third part) follows with slight modi- 
fication from Piagct's (iir/U) original usages. The final distinction 
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deals with interpretation of wnat siiould be learned as discussed by 
Rosenthal (1966) and Orne (1962). 

One way of summarizing the distinctions in internal activity is to 
differentiate the degrees to which searches through existing knowledge 
in order to map the presented material into superordinatc organizing 
systems. The key to a resolution of the instructional method problem 
eventually rests in a more intense analysis of this distinctipn or set 
of distinctions, between an active, assimilative self-coding, rule- 
generating cognitive process vs. a more passive accomodation to li's 
coding syster and specific responses. 

There are very fev; experimental studies that deal directly with 
this issue of internal cognitive activity and its relationship to in- 
structional method and performance measures; and for the most part, re- 
viewers can only hypotliesize about what £ was doing during learning. 
However, some hint as to the importance of SJs behavior during learning 
is reflected in a study by Gagne and Smith (1962) in which a major variable 
was whether or not S was instructed to verbally search for a justification 
of each m^ve in learning to solve a problem. The problem was the liwert 
and Lambert (1932) "disc problem" or what lirnest and Hewell (1969) called 
the "tower of Hanoi problem": given three circles arranged in a triangle 
with some number of discs in circlo 1 arranged in order of size with the 
smallest on top, the problem is to move the discs from circle 1 to circle 
2 in the least number of moves, moving the discs one at a time and never 
putting a larger disc on top of a smaller one. 

The solution involves learning the general principle: "If the 
number of discs is odd, move first to the circle that you want to go to 
eventually;- if even, m^?vc firr.t away froni this circle, Coi;ti.nnu by iv.oving 
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discs with odd numbers always in a clockwise direction, and discs with 
even numbers always in counter-clockwise direction," The Ss learned to 
solve the 2-disc, 3-disc, 4-disc, and 5-disc problems under the following 
conditions: (1) Group V-SS in wliich S was instructed to verbally state 
why he made eacli move and to think of a general principle involved, (2) 
Group V which involved just the instruction to verbalize, (3) Group SS 
which involved just the instruction to think of a general principle, and 
(4) Group No which received neither instruction. 

All S^s eventually learned to solve all the problems with Group SS 
and Group No taking less time but making sliglitly more excess moves, 
Hov/eyer, on a transfer test comprised of the 6 disc problciri in which no 
verbalizations were required, Ss who liad verbalized during learning per- 
formed significantly better than non-verbalization S s , The effect due 
to instructions to think were not significant. However, it is known that 
effects of this kind of variable can be reliable; uncan (1963), using 
a different problem task, reported significant <3ffects due to "tliink" 
instructions , 

The performance of ^s on the 6-disc problem is summarized below; 

Groups 
V-SS V SS No 
Mean bxcess Moves 7,9 9,3 48,1 61,7 

Mean Time to Solution (min,) 4,2 3,S 10,1 10,0 
Ss who vocalized during learning also were better able to state the solu- 
tion principle. Six of the 14 £s in the verbalization group coiUd state 
the complete principle as opposed to none of the 14 non-verbalization S s , 

There are several possible explanations why forcing S^ to verbalize 
while prac. ing the three-circle problem resulted in superior transfer 
and aLiility to state the general principle, Une interpretation is that 
the verbalization S^s were r.»ore active during learning; the requirement 
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to vei^baiize forced them to scorch their existing cogjiitive structures for 
justification oi their moves. Gagne and Smith (p. 17) stated the influence 
of verbalization on internal cognitive activity as follows: "Requiring 
verbalization somehow forced the S^s to think 

Performance dimensio ns; In addition to Che relatively undeveloped measures 
in internal activity during learning a factor only partially reflected 
in ipeasures of learning difficulty such as time or errors to criterion 
several important measures of learning outcoines have been established. 
The most common measures have been: (1) retention, including immediate ^d 
longer term ability to perform the learned task; (2) transfer, including 
the ability to apply the learned n»atcrial to new problems botli near to and 
far from original examples. Others include (see Cronbach, 1966): "con- 
viction" or "adherence to a principle in a confusing stimulus situation", 
"rationale" or the ability to explain a principle in terms of other con- 
cepts, "interest" in the learned material as indicated by questionnaire 
responses, "savings" in learning a related problem solution, and ability 
to "verbalize" the rule or principle involved. 

Procedure ; In order to determine the relationship among external (in- 
structional), internal (cognitive), and performance (outcome) dimensions, 
an experimental procedure must be developed. Katona (1940) was one of the 
first to explicitly propose a paradigm whereby previously unknown problem 
solutions would be taught by two or more different methods to an equal 
criterion, as summarized below (p. 7): 

STAGb 1 STAGt: 2 STAGB 3 

Not knowing A or Application of learning Knowing A or 

being able to method I. being able to 

perform A. Application of learning perform A. 

method II. 
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Vhc fourth stage involves taking performance measures of learning difficulty 
and out. come • 

Cronbach (1906) has suggested sone features that limit the generality 
of instructional method experiments. They include the nature of the subject 
matter, the age and other characteristics of the subjects, the specific 
type and amount of instruction, the specific outconie variables employed, 
and the size and scope of the design. Most of the studies reviewed in this 
paper involve problem solving situations such as decoding anagrams, choosing 
the item that doesn't belong, learning mathematical principles, learning 
card trick*; and matchstick problems. Researchers using more conventional 
materii^ih hcivt; called into question the generality of findings regarding 
these "puzzle type problems'^ and have indicated that instructional method 
effcctci may be due largely to the tyj^e of material used. 

Most of the subjects in the experiments to be reviewed were adults 
or high scliool students, although some studies involved younger children 
and they will be noted. There is reason to believe that many studies used 
disproportionate numbers of subjects of high intelligence, ability and 
motivation. The specific instructional and outcome variables are often 
poorly defined or peculiar to a particular problem solving situation. 
Lastly, the studies to be reviewed largely involve short-term lab studies 
rather than larger, more long-term field studies in actual classroom 
situations (for reviews of field studies see Coop and Brown, 1970; Delia- 
Fiana, 19G5). 

The existing experimental literature regarding instructional methods 
can be criticized not only for its problems with extrapolation of results, 
but also for its problems with inadequate statistical analysis a flaw 
often criticized in tho literature, such as Melton's (1941) attack on 
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Katona^s (li^4U) work or Olson's (1965) questioning of llaslerud and 
Meyers* (1958) experiment. 

By developing a reliable procedure, and defining the various levels 
of the three experimental dimensions, the instructional method problem 
becomes: V/hat is the relationship among instructional metKod, internal 
activity, and outcome performance? In the review that fo. ^cws, an attempt 
will be made to summarize the findings with respect to each ox the ex- 
ternally definable instructional variables and subsequent performance 
measures. In addition, an attempt will be made to suggest what interna* 
cognitive activities or sets may be evoked by the various instructional 

The Research 

Amount an d type of direction, internal activit y, and jjerformance: Because 
there is a pervasive lack of coordination among studies of instructional 
method as to the defining and naming of methods of instruction, many 
problems can arise simply from semantic disagreements. For example, what 
one author calls "directed" teaching (Craig, 1956) another calls "inter-- 
mediate direction" (Kittell, 1957); what one author describes as "discovery" 
teaching (Bruner, 1961) includes what others call "guided discovery" (Gagnd 
5 Brown, 1961), "expository" teaching (Roughoad § Scandura, 3.968), or 
"reception" teaching (Ausubel, 1961). 

Such difficulties could be minimized if standard definitions based 
on Si single external dimension, e.g., amount of direction, were applied 
across all relevant studies. A summary of such studies reveals that there 
seems to be, at least, three general levels of the amount and type of 
direction: (1) minimum direction in which £ receives rei>rescntative ex- 
ain])Jes to solve on iiis own, (2) method direction in wi\ich receives 
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representative examples plus some hint oi* ciireclioa as to the luclhod or 
principle required to generate the answer, and (3) ansv;er direction in 
which the final answer is explicitly givcji to for representative ex- 
amples. A fourth level with method direction and answer direction is 
also possible, though seldom tested. 

The earliest lab studies in this area tended to involve human problem 
solving situations as subject matter. For example, in 1952, iiwert and 
Lambert published a study in which _Ss were taught to solve the three 
circle problem (as described earlier) using four different methods, 'be- 
ginning with three discs, subjects solved the p::.oblem to a criterion of 
two correct, then added a disc and £ ai'ain worked until correctly solving 
the problem twice; and this procedure was repeated until S finished the 
problem using eight discs. 

The methods of instruction, ordered in teinis of low to high amount 
of direction, were (1) present problem without any liints, (2) present 
problems and ask £ to look for a general princij^le, (3) present problem 
and tell £ the general principle (as described < irlier), and (4) present 
problem, tell £ general principle, and provide (k'iiionsti-ation of the principle 
The first two methods could probably be classified as minimum direction 
methods, while the last two methods seem to provide method direction. 

As a performance measure, L;wcrt and Lambert used a sort of savings 
on transfer measure by comparing the difficulty in solving the 4, 5, 6, 7, 
and 8 disc problems for the four instructional }^roui)S, as shown in Table 1. 
Lwert and Lambert concluded that increased instruction decreased average 
ni; TM. of trials, excess moves, and time in tranr.fer learning. 

It appears tliat providing S with the recjuircd Viroblem-solving 
principle in gem^ral, saved time and effort in .Iciindu^i to solve the 
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TABLL 1 

Performance on Traiisfer Problems by Instructional Group 
(Data from liwert and Lajnbert, 1932) 



Instructional Average Average Average Total 

Group Total Trials iixccss Moves Time (sec) 

1 44.2 1154.6 8502.4 

2 42.4 757.9 6220.2 

3 IS.l 300.8 2435.1 

4 16.3 304.6 2481.8 



probie:ns to v.'M^.h it applied. The gcncrailiy of this fact is liiTiitcU 
by the nature of the task, a very difficult one; in otiicr words, state- 
ment of the general principle involved may increase learning and transfer 
efficiency only in situations in v/hich would not otherwise discover the 
principle. In the present case, the inability of Group 1 and Group 2 Ss 
to verbalize the solution principle suggests that ^'learning by discovery" 
Ss may simply have never come in contact with the to-be- learned content 
material. It also seems that the problem is of sufficient complexity 
that the act of trying to apply the principle requires some active search 
and retrieval processing on the part of tlie subject; hence. Group 3 and 4 
learning may involve a ^'mefiningful learning set" as well as obviously 
satisfying the "content conditions" (Ausubel, 1961), 

Evidence that it is not minimum direction per se tliat produces poor 
learning but rather a failure to come in contact with the required to-be- 
learned content, is provided by Gagne and Smith's (1962) finding that 
Ss given no direction but who could verbalize the correct solution principle 
(and hence had discovored tiie requiroc) content) demonr.trated the Simn trans- 
fer advantages as i-wert aim Lai;it)'ji I ' s Group 3 aiici 4 Sb • 
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The Luchins work (Lucriins, 1942; Luchins {i Luchins, 1950) provides 
another classical indication of the detrimental effects of minimum 
direction: not an inability to come in contact with a solution principle 
as in the iiwert-LaDtbert stnJy, but rather a failure to develop a solution 
principle of sufficient breadth and generality. The Luchins ^'jar problem*' 
involves presenting with tiie hypollietical situation of having three jars 
of varying sizes as well as an unlimited water supply, and asking £ to 
figure out how to obtain a required amount of water. The problems, in 
order of presentation, are reproduced in Table 2, 

"i Ah ill 2 
The Luchins Jar Problems 
(From Luchins J 1942) 

Problem Given Jars cf the Pollowin^; Sizes Obtain the Amount 







A 


n 


C 




1. 




29 


3 




20 


2. 


tl 


21 


127 


3 


100 


3. 


1-2 


14 


16.) 


25 


99 


4. 


Li3 


18 


■13 


10 


5 


5. 


U4 


9 


42 


6 


21 


6. 


E5 


20 


59 


4 


31 


7. 


CI 


23 


4y 


3 


20 


8. 


C2 


15 


39 


3 


18 


i). 




28 


76 


3 


25 


10. 


C3 


18 


48 


4 


22 


11. 


C4 


14 


36 


8 


6 



Subjects in the experimental group solved the problems El through 
t5 by discovery, being given no dii-ection other than a statement of the 

problem and the constritint? , Lucln.rjs found that S^s in this group seemed 
to Icrz^n the solutioa priiicij-Je - A - 2C quite well; however, on problems 



20 



CI through C4 which constitute a sort of transfer task, experimental 
Ss continued to apply the B - A - 2C rule even though more 'direct solutions 
were possible. Control Ss who began with problem CI showed a much higher 
percentage of these direct solutions than did experimental Ss. 

One interpretation is that on easier tasks such as this one, 
minimum direction may fail to allov/ to come in contact with solution 
rules of satisfactory generality. In the present case, even torpedoing 
procedures (Uavis, 1958, 1966; Bruner, 1963) such as problem 9 which is 
not solvable by the B - A - 2C rule, having S^ write ''Don't be blind,*' or 
limitir.jR th'^ aiW.ia of \/aler r:vaiJ::ble of"^-^!-' fail tc broaden the dis- 
covered rule. 

Katona (1940) provided anotJier set of problem solving situations, 
namely '*card tricks" and '^matchstick problems.*' A typical card trick 
problem involves figuring out how to arrange eight cards such that if 
S deals the top card face up on the table, puts the next card on the 
bottom of the deck without determining what it is, places the third card 
face up on the table, puts the follov/ing undeterri^ncd card on the bottom, 
and so on until all cards are dealt, the cards put on the table follow 
the sequence: red, black, red, black, red, black, red, black. 

The problem solution is taught by two methods: (1) ^'learning by 
memorizing,** an answer direction procedure in which the specific order 
of the deck (i.e., RRBRRBBB) required for solution is given to S^ in its 
entirety for S to mejnorize, and (2) "learning by understanding,*' a method 
direction procedure in which U provides a system the **diagram method'* - 
for going about solving the problem. The system is to write down the 
retjuired color for c:ic;t c<)rd for c<';ch vvvi throu^'h the deck as is shown 
below: 
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ill 1 -I i I i 
Beginning ???????? 

First Run R ? B ? R ? B ? 

Second Run R ? B ? 

Tliircl Run RE 



Required Order RRBRRBBB 

In one experiment subjects in the memorization group learned task 3 
(presented above) and task 4 (by dealing out every other card produce the 
chain of spades from ace to eight) by memorizing the required deck order 
for four minutes while Ss in the understanding group had the same time to 
ieain, by means ol the suggested diagram, now to arrange the deck lor task 
5 only, A control group received no training. An immediate transfer task 
consisted of the previously learned task (task 3), an easy variation of 
tusk 3 (task 1> output HRBRBR by dealing every other card) and a difficult 
variatiua (task 2, output same as task 3 dealing every third card); a four- 
week rctontion-transfcr task consisted of task 3, task 4, and task 5 (same 
output CIS task 1 except deal out every third card). 

The results are summarized in Table 3 in terms of percent correct 
with r-iterisks indicating that had the task as an example during training, 

TABLE 3 

Percent Correct on Transfer and Retention Problems 
for Two Instructional Groups and Control Group 
(Data from Katona, 1940) 

.Transfer Test 

Group Mem (N = 26) 
Group Und (N =25) 
Group Con (N =32) 
detention Test 
Group Mem (N :'22) 

^ Group Und (N =21) 

ERJC" Group Con (N ==22) 



No. 1 


No. 2 


No. 3 


23 


8 


42* 


44 


40 


44* 


9 


3 


9 


No. 3 


No. 4 


No. 5 


32* 


36* 


18 


48* 


62 


■52 


9 


14. 


9 



22 



As can be seen, DiCinoz'i zation S^s (liroup Mem) performed slightly better 

on inunecliate retention but much worse on transfer and long term retention 

than understaiidinjj Ss (Group Und) . 

Katoaa also reported studies in which Ss learned to solve *'match- 
stick problems" by several instructional methods. Two of the instructional 
ir.cthods \;cre: (1) Group Mem, an answer direction group in which the com- 
plete solution steps were presented to in order, moving one stick at 
a time, and repeating six times, and (2) Group Help, a method direction 
group in which I; presented a series of hints by shading in squares that 
are essentia^ and pointing out sticks to be moved. For example, for thr 
piubiuiii bcluw in wliicli S iuust move three sticks to get four squares (of 
sides 1 stick wide and 1 stick long) , the first method involves showing 
S the recvaircd moves: 



pn'"n n rrr nrrr n n 

Tnc sc cor. d i.:'jt]iO;i iiivolve^i a series of hints accompanied by *'Try to 

Aj^ai.n, the ;:'.:i)y;ory i^cthod r>ccr:is to fit the answer direction classification 
(giving; the aiK^'.er in final form for representative examples) while the 
help methou reflects method direction (giving methodological liints for 
solving representative examples). 

In a typical experiment, all Ss were given a foretest to assure an 
initial state of inexperience, practice on two tasks via a given instnjctional 
method, and delayed tests (for some Ss after 1 week, for others after 3 weeks) 
on the learned tc'.r,ks as well as on the two new transfer tasks. The results, 
in terjf^s ol* porc^jnt correct, are given in Table 4, 
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TABLli 4 

Percent Correct on Practiced and New Tasks 

after Unc or Three iVceks 

for Two Instructional Groups and Control Group 

(Data from Katona, 1940) 

Group Mem Group Mem Group Help Group Help Group Con 

(K = 26) (N = 28) (N = 22) (N = 27) (N = 30) 

Test after 1 week 

Practiced Tasks 67 58 12 

New Tasks 25 55 ' 12 

Test after 3 weeks 

Practiced Tasks 53 52 • 12 

New Tasks 14 55 12 



The Group Mem Ss , who had answer direction, performed quite well, better 
than the Group Help Ss on retention (both after 1 and 3 weeks) of the solu- 
tion for practiced tasks; however. Group Help Ss, who received only method 
direction during learning excelled (as did Group Und Ss with card tx^icks) 
on transfer tasks. 

In both kinds of studio-s, answer direction had the effect of aiding 
retention of the solution for specific examples learned, while method 
direction had the effect of aiding transfer to new and different problems. 
One contradiction to this generalization is the often poor transfer performance 
of a method direction group Katona labeled Group Arith. These Ss learned 
to solve representative matchstick problems by ib stating the "double function 
principle" (e.g., when going from 5 to 4 squares "all lines with a double 
function, that is, limiting two squares at the same time,. must be changed 
into lines with a single function, limiting only one square") and then pre- 
senting the solution steps. One reason why Group Arith Ss often performed 
like Group Mem Ss rcay be that It was possible for them to memorize the 
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answer without evci hciving to undorstajiu how to apply the double function 
principle, 

1l\\o desip.ii, the lack of clear definitions, and particularly, the 
lack of statistical analysis have been well criticized (see Melton, 1941; 
Katona, 1942) aiul to the extent that these criticisms are justified, an 
interpretation of Kat07ia's results is difficult. However, the detrimental 
effects of ansv.'cr direction with respect to transfer performance was 
establisJied as an important research issue* One possible interpretation 
of such findings is that overspecification of the correct answers for 
represent at i^'e oxanples, especially for rf*1atively easy problems such rc 
thcse^ reduces tiie pi v>bcibiii ly of actively searching for some general 
strategy and encourages a passive registration of solution sequences 
Ausubcl's '*rotc learning 5;ct.'' .Conversely, method direction ercourages 
active iivaoxy senrcJ) in order to interpret E^'s hints, and apparently also 
allows S to make contact with the required solution strategy. Just as 
the I:v;ert~l.aKibcrt and Luchins work pointed to the detrimental effects of 
minir.um dire.ctit'/i (pcirhaps due to S*s failure to find the appropriate 
principle), Katona*s v/ork suggests one look for- similar detrimental effects 
of suiswer direction with respect to transfer (perhaps due to S^'s failure 
to encode the content into a broad or meaningful cognitive set) • 

Some suppoxt for this Antcx^pretation comes from a study by Gorman 
(li)S7) in wliicli Katona *s matchstick problems were taught using nine methods. 
In .all cases, throe rcpvesentntive problems were given with either **no,'* 
••some" (a clue to note the number of sticks involved), or **much" (a state- 
ment of the principle) information about the 'double function principle," 
and '*no,'* *'so;:ic" (r.Jindnui of critical squares), or ''much" (indication of 
sticks vw Movc) J rifn.r:.rjt:ion about the method of solution. A transfer test 
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to both simple (very similar) and complex (different) matchstick problems 
and a principle verbalization test yielded the result that, on the average 
guidance Ss performed better than no guidance Ss . For information about 
the method, **soine** and ''much*' information produced better transfer than 
•'no*' information. For information about the principle, the more informa- 
tion given, the better £ could vei-balize the principle at the end; however 
no consistent effect on transfer was noted. 

The *'no information*^ Ss correspond closest to a minimum direction 
classification, the "some" and "much information" Ss correspond to what 
was class j'^ied as method direction in the Katona experiments and thc^e 
was no group fitting the answer direclion class such as Katona 's ''Group 
Mem," Putting the Gorman and Katona results together, method direction 
(presentation of examples with hints concerning the metliod of solution) 
resulted in better transfer tlian either minimiun direction (no hints) or 
answer direction (specification of exact solution steps) for matchstick 
prcblciTiS, Again, however, the fact that presenting the double function 
principle did not consistently aid transfer in either set of experiments, 
points to the need to better undcrstiind hew hints influence S, 

A series of experiments by Hilgard and his associates (Hilgard, 
Irvine 5 Whipple, 1953; Jiilgard, Edgrcn 5 Irvine, 1954) atteinpted to 
analyze more closely the learning behavior of subjects in Katona 's card 
trick problems. In one experiment (Hilgard, lidgren 5 Irvine, 1954) £ 
was 1 aught to solve two examples using one of five variations of "learning 
by understanding"; (1) Katona*s diagram method, (2) same method using only 
one horizontal row, (3) same method using only one vertical row, (4) 
same method using blank pieces of paper, (5) working backwards using the 
actual deck. Although there were no diffci-enccs among the methods in a 
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subsequent transfer task except for method S, what did interest the authors 
was the fact that S s ' errors were isolated to the type of method used, as 
if even ''learning by understanding" Ss comraitted errors suggesting a 
mechanical or rote application of the various ''helps," 

In comparing a "memorizing" group with an "understanding" group, 
Hilgard et al , (1953) found that the understanding group took significantly 
longer than the memorizing group to solve the two practice problems (a mean 
of 150 and 123 seconds for the memorizing Ss and 435 and 202 seconds for 
the understanding S^s for the two tasks respectively) , performed no dif- 
ferently fr'^m memorizing £s on a 1-day x^etention test although having had 
thn advantage of twisc the practice, and performed significantly better 
on a set of traiisfer items (a total of 3, 1 and 1 correct responses from 
30 memorizing S^s and a total of 16, 7, and 10 correct from 30 understanding 
Ss for the three tasks respectively). 

Along Mxth this replication of the Katona finding of the superiority 
of method over answer direction on tests of transfer, Hilgard et al. pointed 
out that many so-called "understanding" £s did not really understand the 
diagraming device in the full sense. In support of Ausubel's (1961) claim, 
the transfer performance of many of Hilgard 's method direction or 
"understanding" Ss demonstrated that a supposedly meaningful principle 
fnaiTicly, the application of the diagram method) could be learned in a 
mechanical way. Apparently, although the diagram hints more often than other 
methods lead to a true, broad understanding in the sense of an ability to 
relate it successfully to new instances, some "understanding" Ss managed 
to encode the diagr^un principle into a "rote" or "low meaningful learning 
set," 

A second naior subject area has been teaching S_ to pcx^form in principle 
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or concept identification tasks of various types under various instructional 
methods. Craig's (1956) experiment is the fore-runner of more recent 
method-of- instruction studies. The procedure was to present the following: 
pretest, training A (on tJie first day), training; 13 (on the fifteenth day), 
training C (on the 2yth day), retention test (on tlie 32nd day), and finally 
a tri'.>fer test. The training involved finding *'the word tliat doesn't 
belong" in sets of five words. Tor example, given: 

CYCLH SiiLDOM SAWDUST SAUSAGli CliLLAK 

the appropriate answer is to mark CYCLl: since it doesn't share the same 
initial sov^^d as the other words. Item'; were organized in sets of fov-* 
aii having the same reiauionai rule (e.g., initial sound) and each training 
booklet contained several sucli types of rules. 

Two instructional methods were used: one group the ''directed 
group" was told the relation (e.g., "look for initial sound") at the 
beginning of each set of four items but was not told the ajiswer per so, 
while the other group -~ the "independent group" was told neither the 
relational concept nor the correct answer. In this case it seems that it 
is fairly reasonable to differentiate tlie groups in terms of amount of 
direction witti the former fitting the method direction and the latter fitting 
the miniinmn direction classifications. Directed Ss correctly learned 
significantly more relations in each of the three training sets than in- 
dependent Ss and a retention test held on the 32nd day also indicated a 
c^ear superiority of the directed over the indoj)endcnt S^s for rclearning 
in all three training sets. Transfer tests yielded no significant dif- 
ferences between the groups. 

In short, Craig points out that the directed group ~- a group re- 
ceiving 5ome direction concerning method learned More efficiently, 
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ret:aincu bettor ar.d trani;f erred just as wull as the independent group 
a group receiving minivoum direction. This study complements the previous 
findings usin^; other problem solving situations and calls into doubt the 
emphasis on extreme classroom freedom and independence: S^s may simply not 
be able to uncover the appropriate concepts or rules without some direction 
The fact tliat independent Ss solved significantly feWer items during 
training underscores this hypothesis; liowever, the failure of both groups 
to reach the sajnc initial criterion of learning makes interpretation of 
the retention and transfer data more difficult. 

The hypothesis to be tested is this: The procedure of giving hints 
about tb.c principle oi' fncthod but not giving S th^ exact answer in final 
forra encouraged £ to actively searcJi and discover how the hints apply 
to the material. Subjects given no direction may simply never identify the 
relational concepts and hence have to encode in a piecemeal, item-by-item 
wiiy just as answer direction Ss are encouraged to ignore rules and rather 
to encode specific answers. Such an interpretation helps "make sense*' out 
of the fiadinps; however, to correctly test the hypothesis of structurally 
different learning outcomes, and not just differences in initial learning, 
a uniform standard of initial learning for all groups is required. 

Kittcl (1957) reported a study using material similar to Craig *s 
but whic)) involved a better controlled learning criterion, instructional 
groups representing all three levels of the amount of direction, and a more 
sophisticated transfer-retention test. The procedure consisted of a 
pretest, training, and three posttests on the first, fifteenth and 29th 
days. The training, like Craig's, involved giving S^ a set of five words, e 

GONJi START GO STOP COME 
and iiiikihy, 6 tv ivmrk word tnui doesn't belong. In the above exa/nplo. 
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the reiationai principle is "foi-iii two pairs of oppositcs" cinJ, Ik-dcc, 
the answer is ''Gone." in the training booklet each group of three items 
had the same principle and there were IS such groups in all. 

Three instructional conditions, reflectin^j varyinj^ amounts of 
direction,- were used: (i) Subjects in the "/ninimu/n direction" ^rouji were 
told only that each group of three problems had the same underlying princij^le 
(2) Subjects in the "intermediate direction" group were told v»*hat the 
principle was for eacJi group but were not given the specific answer, (3)Suh- 
jects in the "maximum direction" group were told both the correct ans\ 2t 
and the principle* In comparison to the Craig study, the "minimuia dircctioii" 
group corresponds to Civaig's "independent" group, tli*^ ''interjiiediate direction 
group corresponds to Craig's "directed" group, and the "luaximum direction" 
group represents both method and answer direction, a group omitted from 
the Craig study* 

On the first, 15th, and 2yth days Ss were given the original 
training booklet (without rules or correct answers indicated) as a retention 
test. Also on the first day, two transfer tests were adnunistercd, one in- 
volving tJie prinicple but with differv?nt items (near transfer) and tlie other 
involving both now principles and new items (far transfer). The findings, 
indicating number of principles correctly learned or relearned, are in Table 

TABLi: 5 

Average Number of Correct Items on Retention and Transfer Tests 



for Three Instructional Groups 

(Data from Kittel, )9S7) 

Minimum Intermediate Maximum 

Direction Direction Direction 

Immediate Retention 2.6 3,7 3,7 

.Near Transfer 1,L) 4.() 2,0 

Far Transfer 1.7 4.0 2.7 

Two-IVeek Retention 1.0 3.5 2.9 

Four- Week Retention 1.2 3,3 2.3 
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As can be seen, the minimum direction group as in the Craig study 
apparently learned less, as measured by immediate retention, and performed 
poorly on retention and transfer tests as compared with the other two 
groups. However, the intermediate and maximum direction groups reached 
the same level of initial learning as measured by immediate retention, but 
differed significantly in their respective transfer and- retention tests, 
thus* suggesting more complicated differences in learning outcome. 

The suggestion that S^s in the different instructional groups are 
performing different cognitive acts during learning has been the object • 
of more recent study, Kornreich (1969, p. 384), for example, stated: 
**Clt5cii*ly^ studieb art? needed which specify how teaching procedures differ 
for groups, how these procedures differentially affect S^'s behavior during 
learning, and how both teaching procedure and S^s studying behavior results 
in differences in criterion pervormance." 

In addition, Kornreich (196fJ) reported a study involving the re- 
lationship between instructional method and S^'s behavior or "strategy'* in 
a CI task. The problems consisted of four cards, with two stimuli per 
card, each varying in color (black or white), size (large or small), letter 
(T or X), and position (right or left), e.g.. 




The, S was required to point to one stimulus and jE responded *'right'' or 
"wrong,'' after which S was required to indicate all possible correct cues. 
This was repeated for all four cards of each problem, and there were 24 
separate problems in nl) . The optimal strategy involves a "focusing" pro- 
cedure whereby S reduces the number of alternatives to four after card 1, 
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to two after card 2, and 1 after card 3, for each 4-card problem. 

Tlie instructional methods for learning to solve the 24 problems 
were: (1) '^discovery group" which received no hints, (2) "guided discovery 
group" which was told after each card whether the procedure £ was using 
v.'as or was not optimal. (3) "programmed" group which was told after each 
card the appropriate moves to make. The groups correspond to the minimum, 
method, and answer direction classifications, respectively. Kornreich 
was mainly interested in S^^s ability to develop the optimal "focusing 
strategy" and the results indicate that significantly more of the guided 
discovery (20 out of 33) acquired the focusing strategy than either 
discovery 5^ (5 out uf 33; or prograjiynuu Ss (ii out of 55), 

Again, as in previous studios, it seems discovery Ss simply fail 
to discover the required principle or concept while an.ower direction Ss 
react to "overprompting" by encoding specific correct responses ratJier 
than the solution principle. Kornreich suggests the advantage of the GD 
group rests in. its rereading and thinking about tha original instructions; 
GU subjects not allowed to reread the instructions did not learn the 
focusing strategy as well (6 out of 20), The emphasis on finding the 
behavioral effects of amount of direction during learning was summarized 
by Kornreich (p. 388): "The discovery learning controversy, then, becomes 
a considered analysis of what educational prompts are optimal for achieving 
educational goals, ratlier than an issue over whether discovery or rote 
Iparning is better." . 

Guthrie (1971) reported an exj^eriment in which sixth graders, from 
both low and high socio-economic status (StS) homes, learned a language 
concept accompanied by different amounts of S bohnvior, prompted by dif- 
ferent amounts of direction, "ihe concept wos: "After the woi'd *thc* K 
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comes before consonants and T comes before vowels'' (e.g., ''the K girl 
scout** or **the T outlaw''). All S^s performed in a vowel -consonant dis- 
crimination task to a criterion of 40 correct, and all Ss perfoi-med to 
a criterion of eight correct in a concept formation task consisting of 
sentences of the form: "That girl was the K girl scout. Change girl 
scout to outlaw/* 

In addition, (1) Group 1 Ss memorized the rule as stated above to 
a criterion of two correct verbali nations > applied the rule to questions 
about example words or sentences (e.g., What comes before words that begin 
with vowels?}. au'J uroduvie'l iusr^uces for i:»xar»p3.e word?;: (e.g,^ given *'ap:;'^:/* 
respond "T apron") to a criterion of 12, (2) Group 2 Ss performed only the 

first two tasks, (3) Group 3 Ss performed on the first task, (4) Group 4 
Ss perfonned in none of these tasks • Group 4 represents a minimum 

direction gi*oup in that no rule or hint or answer was provided, while the 
other groups represent varying levels of method direction in that methodo- 
logical hints are given but specific answers are not. 

An analysis of trials to criterion on the concept-formation task 
for both SCS levels indicates a significant effect due to instructional 
method with better performance for groups that had more directed tasks in 
learning, as shown in Table 6, 

TABLE 6 

Avere:ge Number of Trials to Criterion 
for Four Treatment Groups and Two SLS Levels 
(Data from Gutlirie, 1971) 

Group 4 
50.0 

50.0 
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Treatments 
Group 1 Group 2 Group 3 
Low Si;S iS.U 21.7 32.6 

High SliS 6.5 8.6 21.7 
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In a relatively difficult task such as the present one, rule verbaliza- 
tion siKnificanily improved S ^ s performance, and having apply the rule 
in response to li^*s questions also improved savings in subsequent learning. 
Direction about the solution method which provides both the required rule, 
and a cliance to understand it by trying to apply it in complicated (for 
children) examples seems to offer advantages in ease of learning over 
minimum directicii ntethods. However, as in the Korni^eich study, little 
can be said about retention or transfer. 

Experiments using decoding tasks offer a more direct test of 
retention transfer performanr.o . For oxui^ipiCj Fergus and Schwartz (IPTV) 
taught a 20- symbol alphabet by three instructional methods and recorded 
measures of ease of learning, retention and transfer. The to-be-learned 
code was : 

A B C F H P G M 1 J K L M N 0 P Q R S T U V W X Y Z 

The instructional methods were: (l)*'observer group" which was 
given the code as presented above wit)i a written explanation of the 
principle, (2) ''participant group" wliich was given tlie code as presented 
above and told to look for a verbalize the principle, and (3) "memoriza- 
tion group" which was given the same 26 pairs as above but randomly 
arranged so tJiat the principle was difficult to find. Assuming the 
orderly arrangement is enough hint for "participant" Ss to recognize the 
rule, the first two groups are metliod direction metliods which enable 
to encode a general principle or strategy while the final group is 
like otlier minimum direction, discovery methods forced to encode the 
material in a specific, itcm-by-item manner. This interpretation of 
wliat _S is doin.i', during learniiiji^ is consistent with the fact that 
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•Memorization^* Ss took tvdcc as long to reach a criterion of learning as 
Ss in each of the other groups. 

One week latei^ li aci^nJ jiistoi-cd a recall test requiring £ to 
translate a passage frc!<^ the learned code into English, a near transfer 
test requiring to traiislatc a passage from a slightly modified code 
(S is given A =A> ^ J = T Z = f', and must generate the 

rest) into linglish, and a far transfer task requiring to translate 
a passage from a very different code (S^ is given A s= 11, B = 12, C ^ 13, 
D 14, E = 21, F = 22, G = 23, 11 = 24 , I = 31 . • . 2 = 62, and must 
generate th^ rest) into iinglrsh. The nur;.b«^r of words correctly txanslriitrd, 
out of a possible total 52, for nach group on each task is indicated in 
Table 7- 

TABLH 7 

Average Ni:r;ber cf IVordo Correctly Translated 
on Recall and Transfer Tests 
for Three Instructional Groups 
(Data froni PovvMS and Schwartz, 1957) 

Recall Near Transfer Far Transfer 
Observer Group 50 30 34 
Participant Groi;p 52 31 37 
Memorization Group 37 11 10 

As can be .seen, r])o firrt two groups not only learned significantly 
faster but also retainer mor^ and transferred better than the third group. 
The 'fact that there was no difference between observer S^s who were given 
the rule (but pr^^siijaably liad to try to understand how to apply it) and 
participant Ss who were rjv::^n hints as to the rule (namely, the orderly 
arrange:nent j suyr:{?sts t;:- rr;^\V wi: .sii:.}>]c enouph for the latter group to 
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find the rule and that both groups encoded the rule in a similar manner. 

Some support and an apparent contradiction to this finding of an 
overall inferiority of minimum direction Ss is reflected in Haslerud 
and Meyers' (lyS8) data. Subjects were given 20 coding problems, half 
with t}ie decoding rule given (^'guided met)iod^') and half with no direction 
given ('^discovery method*'). Iti tests of initial learning it was found 
that Ss learned significantly fewer items by discovery tlian v/hen provided 
intermediate direction. However, in a transfer test held one week later 
in which the same 20 decoding principles were applied to 20 new sentences, 
nf^rform?r>'"'^-, cn the discovery-t^y^ght pr' •iC.'»pic;s equalled perf ornic.'.nce yn 
principles taught with method direction. 

Because transfer performance improved on discovered principles 
and fell on guided principles relative to initial learning, Haslerud and 
Meyers claimed that minimum direction results in superior delayed trans- 
fer. This faulty interpretation based on difference scores rather than 
absolute transfer scores ignores the fact that there was no difference 
between the groups in absolute transfer performance (Olson, 196S) . Another 
problem in interpreting anything more than ease of learning measures is 
that, due to the within-subject design, it is not clear that learning 10 
items by the guided method did not transfer to the 10 discovery principles. 

In a better controlled ''decoding** experiment, Wittrock (1963) taught 
Ss to decipher cryptograms using four insti^uctional methods and assessed 
learning outcomes in tests of learning ease, retention and transfer. The 
task involved deciphering a series of 10 sentences such as HRNTMH DTGEON RKP>\JIE 
(Answer: MhN THRONGED THi2 PARK under the rule '^exchange the first two and last 
two letters in each group"). The first page of each problem presented the 
rule or left rooi\ for it to be derived; page 2 contained an example enciphered 
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sentv^nce with either a space or the deciphered sentence below; and page 3 
contained an enciphered sentence based on the same rule for £ to try (as 
a learning test) . 

The instructional methods were: (1) rule given, answer given (con- 
taining elements of both method and answer direction), (2) rule given, no 
answer given (a method direction group), (3) rule not given, answer given 
(answer direction), and (4) rule not given, answer not given (minimum 
direction). Three weeks after learning, a retention test (same principles, 
same examples), a near transfer test (same principles, new examples), and 
a far transr<.T t«st (new principles, new examples) were given. The avcra;2e 
number correct out of 10 for each group is given in Table 8. 

TABLB 8 

Average Number of Correct Items on Reteiition and Transfer Tests 

for Four Instructional Groups 

(Data from IVittrock, 1963) 

Learning Test Three Week Retention-Transf e r Test 

No. Learned Ti mcT Retention Mear -Transfer Far^'ransfer 



Rule-;\o Answer 


y.7 


SI 


5.8 


4.9 


4.0 


Rule-Answer 


9.5 


47 


5.3 


4.2 


3.2 


No Rule-Answer 


7.6 


67 


5.3 


4.0 


3.6 


No Kule-No Answer 


2.8 


104 


4.1 


3.7 


3.0 



Presenting the rule and encouraging £ to actively figure out just how to 
apply it in order to derive the correct answer, again, resulted in superior 
learning, rotention and transfer as compared with groups given either no 
direction or given an exact specification of the answer. . Wittrock con- 
cluded (p. 189): *'ivhen the criterion is initial learning of a few responses, 
explicit M.nd detailed dirc<:tinn seems to be most effective and efficient. 
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JVnen the criteria are retention and transfer, some intermediate amount 
of direction seems to produce the best results/' 

An experiment by Guthrie (1967) in which Ss learned to decipher 
cryptograms, demonstrated that when minimum direction Ss (given repre- 
sentative examples without rules or hints) were forced to learn to a 
criterion equal to that of groups given the rule, they took longer to 
learn and retained less but transfered better in some cases* Apparently, 
if minimum direction Ss do learn the decoding priviciple tliey are able to 
transfer quite well; and if rule-given Ss are able to memorize simple 
procedurer. rather than develop m-jM^r^x f^crod^ng tecliniquos, they exccll 
only in learning ease and short-term retention, 

- Another major :>ubject area has been learning to solve mathematical 
problems, Gagne and Brown (1961) taught Ss how to calculate series sums 

and derive formulae (e,g., sum of 1,3,5,7,9, , , ...) using three programmed 

instructional methods. In order of minimum, method and answer direction 
they are: (1) "'discovery" which asks S to find the sums of representative 
series but provides hints if S^ cannot, (2) '*guided discovery" wliich presents 
a systematic succession of questions to aid in solving representative series 
sum problems, and (3) "rule and example" which gives S^ the series sum formula 
and applies it to examples for S, All Ss were required to achieve a criterion 
of correct solutions for the same four series, thus the possibility of 
"discovery" Ss not learning was eliminated. The hints provided the dis- 
covery group seem to make it, like the GD group, more representative of 
the method direction classification, while RE Ss better fit the answer 
direction category. 

Subjects were trained on days 1 and 2, and also on day 2 were tested 
for trajiisfer iu a set of series ])robiems. The avonigc time (in seconds) 



and errors to criturioji lcu:/ninp, cmd znc rivora^\c time and number of 
hints requested in transfer are 7\;)-)ortcd in Table i). 

Avura^^e in Sec'.^iiJs and jNumber of fcrrors 

on Initial ic^rinii^o, ik^lcai'iiing and Transfer 
for iiiiee Inst ructioial Groups 
(Data froji) Gai;nc and hrown, 1961)' 



First Learning; 
Tiin'> (lirrurs) 

SeCunu Leaiaiai^ 
Time (Hrrors) 

Transfer Time 
(Errors) 



lU: Gvv.^up GD Group Discovery Group 

26 (6) 33 (10) 18 (4) 

15 [b) 23 (7) 10 (2) 

27 (o.L.) 17 (1.5) 20 (2,2) 



As can be seen, guided discovery 5>s too!. lon[;cst to learn and made the 
most errors in learning but jxansfcr bci^t; there may be reason to believe 
that these Ss werv iixivc active in terms of cognitive search processes in 
learning than the ot/ior ^^n^upa, c:>] OcjaUy the Rl: group. 

In a carefi'.li)' coniiuUen replication usini^ only Gl) and Rll methods, 
a clear superiority for C\} S:-. jn iLrin^d i ntu and delayed transfer was again 
demonstrated (Del Ja-i'i an.i , iDoSJ . Dcila-Piana also reported that S^s who 
verbalixed the solution loi-t-il.t diO. si^'.iii ficantly better on transfer tasks. 
In contrast to tho t.'.a.^ijc ■ -jj. :r ci- p)} i-.i s cmi ''vvha-u is learned/' Della-Piana 
argued that '*the present. Ji : cint;.- *ho\v something is 'taught* does 

have an impact on learning:. ' 

On this it>'A»v , l^v.i^.i'crui :iP\'i r^oaiv-luoa (llUuS) provide evidence that 
"whaJ is iear^uv'd" -J..-. ; > .\ i hi; vauj.ilit bv other methods. An 
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"expository** program (which presented the same hints as the "guided*' 
program but as statements instead of as questions) coupled with a "rule" 
program (giving the specific formula and liow to apply it) produced the 
same kind of performance as "guided" methods coupled with "rule" methods 
on tests of learning ease and transfer, Appai-ently, as long as the hints 
about principle or method are given it doesn't matter if they are pre- 
sented as questions or as statements • 

It was found, however, that groups given the rule and how to ^pply 
it (answer direction) without any expository or guided frames (method 
direction encouraging active rngnitive search) performed significantly 
better in learning ease and v/orse on transfer than groups exposed to less 
direction* liven when "rule" frames were followed by a chance for un- 
directed "discovery" of tlie just learned rule, Ss apparently were satis- 
fied to retain the correct answer without trying to develop a higher level 
derivation rule to explain why. 

As a complement to the findings concerning the relative merits 

of GD-type methods (method direction) and HE-type methods (answer direction), 

Kersh (1958, 1962) provided some information about minimum and method 

direction methods for teaching series sums. One to-be-taught principle 

2 

was the "odd-number rule," the fact that Z (1 +5+5+7 •••)=N, The 
minimum direction group, called "no help," received representative problems 
with no direction, while other groups received eitlier "direct reference" 
using perceptual aids or "rule given" treatment asking to apply the 
rule to examples, lixamples of these latter, method direction procedures, 
are indicated below: 

j:(1 + 5 + 5 + 7 + . . 0 = Thus ?: (1 + 5 + 5 + 7) = 4^ = 16 



X 








1 


4 


X 


X 


X 




3 


4 


X 


X 


X X 


X 


5 


4 


X 


X 


X X 


XXX 


7 


4 



16 16 
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All subjects were forced to learn to a criterion of three correct 
solutions and verbalization of the rule, hence the usual prospect of 
minimum direction Ss not learning was eliminated. Under rhese conditions 
all groups performed perfectly on an immediate retention-transfer test 
and differences on a four week transfer test and questionnaire favored 
the '*no help** (minimum direction) group, A questionnaire indicated that 
this latter finding could be attributed to higher motivation and practice 
of the no-help Ss rather tlian differences in the meaningfulness of the 
encoding process. However, as in other studies where a criterion of 
learning was enforced, minimuri dlroction s^sem able to loarn in a 
mannei like method direction S^s. In sum (Kersh, 1958, p, 282): "If 
meaningful learning is the key concept it should make no difference 
whether learning occurs with or without direction so long as the learner 
becomes cognizant of the essential relationships," 

In a further study (Kersh, 1962), however, heavily directed Ss 
(given examples with complete explanations) performed significantly 
worse Oil tests of retention and transfer than groups given no explanation 
or only hints in finding the explanation. As Kersh (1958, p, 282) pointed 
out: although different method? can produce the same learning set hence 
the same outcome, "it is very likely that some procedures of learning may 
be superior to others because they are more likely to cause the learner 
to become cognizant of the relationship." Wlien a criterion of learning 
is enforced, it appears that althougl) minimum and method direction Ss 
may encode in the same way, answer direction Ss may use an entirely dif- 
ferent procedure. 

An experiment by Car»r\^, Mayor, Gar.stens and Par;idise (19G2), using 
several variations of the .r.ethod direction mcr.hod, supported tho claim 
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that different methods of instruction enforced to a uniform criterion of 
learning can produce the same kind of learning outcome,. In learning 
programs for several mathematical tasks, neither differences in the amount 
of repetition (i.e., two vs. four example problems per idea) nor the 
amount of guidance (i,e., presence or absence of integrating frames) pro- 
duced a major influence^ on r^itejitior* or transfer performance. 

However, the standard finding of detrimental effects on long-term 
retnntion and transfer for extreme amounts of answer direction was sub- 
stantiated by a study by Ray (1^61) in which S^s learned to use a precise 
moasuring :;.).'*»truii^ent by tv;c instructional methods. There v;ere no dif- 
ferences between Ss who learned by ^'direct and detailed instruction" and 
those who learned by '^guided discovery" on tests of immediate and one 
week retention; however, the guided discovery S^s who received less 
direction about answers performed significantly better on a six week 
retention and transfer test. 

A definitive statement on the effects of minimum, method, and 
answer direction on learning ease, retention and transfer performance is 
not yet possible; however, on the basis of the current literature, several 
generalizations can be posited for further study: (1) As compared with the 
other instructional methods, minimum direction procedures require more 
learning time and effort and result in lower levels of initial learning, 
inferior retention and transfer, and inability to verbalize the required 
principle. However, when the to-be- learned principle is obvious or when 
a strict criterion of initial iearninp is enforced, minimum direction Ss 
are apt to exhibit outcome performance comparable to method direction Ss , 
(2) As compared witii answer direction mjtiiods, mctl^od direction procedures 
require more or less learning time and effort depending on the task. 
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and result in equivalent levels of initial learning, equivalent or inferior 
short-term retention, superior long-term retention, superior transfer, 
and ability to verbalize the required principle, (3) In contrast, answer 
direction procedures require more or less learning time and effort depending 
on the task, and result in equivalent levels of initial learning, equivalent 
or superior short- term retention, inferior long-term retention, inferior 
transfer, and inability to verbalize the required principle. 

Although there have been few direct tests of subject activity 
during learning, the following generalizations constitute worthy research 
issues for farther studies: (1) Minimum d'^rection Ss are actively searc^^ng, 
or as Out; research group (Anastasiuw, Bibley, Leonhardt q Borish, 1970) 
puts it, *'cognitively involved,*' thus satisfying the "set conditions" 
(Ausubel , 1^61), but often fail to satisfy the "content condition" of 
coming into contact with the to-be- learned rule or concept. Lacking a 
unifying principle, material must be coded in an individual, rote answer- 
by-answer manner., or, as is often the case, not encoded at all. However, 
when minimum direction S^s do find the required rule or concept, the sub- 
sequent learning outcome is similar to that produced under method direction. 
(2) Method direction 5s are activf^ly searching for how to apply a given 
complex rule or how to use a given hint, thus satisfying the "set conditions, 
and liavc sufficient direction to come into contact with the to-be-learned 
rule or concept thus satisfying the "content conditions," Therefore, the 
learning outcome can be characterized, not as a discrete set of individual 
responses, but as a general rule or what Roughead and Scar.dura (1968) have 
called a "derivation rule," (3) Answer direction Ss seem to often lack 
the ''set condition" of active search, being uninterested in why the specific 
answers given by arc correct, and striving (like minimum oixoction Ss 
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but tor dificnt rc:.u.on.s) to encode a discrete chain of specific responses. 

Of course, tliere are obvious contradictions to several of these 
propositions as tliorc are to most tempoi^ary generalizations; however, a 
more definitive analysis of the effect of amount and type of direction on 
Icarninjj. re([uircs more information concerning these propositions. One 
particularly important task is to better define what constitutes ''method 
direction" and thur> what types of rules or hints best satisfy the ''content 
condition" without destroying "set conditions," 

S e({uencing of directi on, intorjml activity, and performance : A second 
major diJuensM^n of instructional metliod is the sequencing or ordering of 
direction, ami uuc iiS[)uut of sot{UOnciug that has produced significant dif- 
ferences in outcoiiic performance is inductive vs. deductive sequencing of 
direction. As caily as 1913, Winch presented evidence demonstrating the 
superiority oT deductive over inductive methods for short-term retention 
performance, and tliC r^upcriority of inductive over deductive methods for 
Certain typet^ of tran^^fer performance. In a literature review covering 
the subscquujit half century, Hormann(1969) concluded that there still is 
qualified support for the claim. 

Hor example, in a well controlled classroom study, Worthen (1968) 
used two ,.ietho:ls to teach children such concepts as notation, addition and 
multii)lication of inte^jers, the distributive principle of multiplication 
over addition, and exponential multiplication and division. The "discovery" 
me.thod involved presentotion of examples for to solve followed by verbaliza- 
tion of the required principle or concept (i.e., an inductive sequence) while 
the "expository" method began with verbalization of the required concept or 
princi])lo foJ?cv/ed by ex'ami)]es for S to solve (i.e., a deductive sequencing). 

Si^;nif i cant eiTects due to instructional method were found in measures 
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of learning ease (inductive inferior to deductive) , long-term retention 
(inductive superior to deductive) and transfer (inductive superior to 
deductive) with no differences in subject attitude found. However, a 
subsequent argunient . concerning Worthen*s statistical analysis — con- 
tending that df 's ought to be determined by the number of classrooms 
rather than the number of S^s in the groups has reduced the impact of 
these findings (Korthen d Collins, 1971). One hypothesis proposed to 
interpret such results assuming they can be substantiated is that the 
period of search before rule verbalization, or what Hendrix (1947, 1961) 
called "nonverbalized awareness,^' enables inductive Ss to actively encode 
thn to~bo- learned strategy or concept into a wider or more meaningful 
cognitive set, whereas the presentation of the rule — especially a simple 
rule in advance may predispose deductive £s toward encoding an isolated 
series of mechanical steps. 

Two similar methods for teaching Ss to decipher '^cryptograms'* 
were part of a well controlled laboratory study by Guthrie (1967), The 
deductive '*rule-example" method involved presenting the deciphering rule 

(e.g., '^exchange the first and last letter") followed by examples for 

to solve to a criterion of eight correct while the inductive "example-rule'* 

method called for presenting examples for to solve to criterion followed 

by a statement of the correct deciphering rule. The performance of the 

two groups on initial learning, retention (new words, same rules), near 

transfer (new words, similar rules) and far transfer (new words, different 

rules) is presented in Table 10. Analyses revealed the advantage of 

deductive over inductive training for ease of learning and the advantage 

of inductive over deductive training for near transfer to be at statistically 

si^'^nif icanl levels . 
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TAiiUi 10 

Povfoi'inanco on Lcariiiii^^, ketcntion and Transfer 
for Two Instructional Groups 

(Data from Guthrie, 1967) 

Learning ' Retention Near Transfer Far Transfe r 

Average Trials Average Number Average Number Average Number 
to Criterion Correct Correct Correct 

Rule-iixample 11.9 8.1 4.8 4.1 

Lxample-Kule 23.6 .7.0 7.2 5.; 

Tiic previously cited Rougnead anu Scandura (1968) study also supplies 
some information about the role of sequencing in teaching S^s series summation, 
Of the seven treatments reported, two seem to fit the general deductive- 
inductive categoric:;, namely: (1) "rule-discovery" Ss received three series 
examples with tho rules for solution given followed by three series examples 
to be solved by S using the same rule, and (2) "discovery-rule" Ss received 
the reverse ordering of three to-be-solved series examples followed by three 
more with the rule given for each. Measures of initial learning, near trans- 
fer (same rules, different numbers) and far transfer (different rules, dif- 
ferent nu;nbcrs) arc summarized in Table 11. 

TABLl: 11 

^.Performance on Learning and Transfer 

for Two Instructional Groups 

(Data from Roughead and Scandura, 1968) 

Learning Near Transfer Far Transfer 

Average Average Average Average Average Average Average 

Time Hrrors Number Time Hints Time Hints 

(min.) Correct (min.) (min.) 

Rule-Discovery 29 1.2 5.5 6.0 1.7 5.9 1.6 

ERXC ^^^^^^^'^'y***^'^^^ -'-^ 
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Again, deductive £s learned faster but transferred significantly worse 
than inductive Ss . Roughead and Scandura interpreted such results as 
indications that in some cases (e.specially with easy rules) prior knowledge 
of the solution rule interferes with S's development of a '^higher order 
derivation rule" by encouraging to memorize specific correct steps with- 
out trying to understand why they are correct. 

This interpretation squares nicely with much of tJie text-based, 
(non-problem solving) CAI literature reviewed in recent studies by Ander- 
son, Kulhavy and Andre (1U71) and by Sturges (1972). Those studies 
reve?ied tha"^ fe^ving S knov.'ledge of tlie cc-^xoct respcnso (.KCK) after S 
responds to example questions results in significantly better transfer 
performance than giving KCR before examples. Other non-problem solving 
studies demonstrating a relationship between poor transfer and lieavy 
prompting on questions during learning (Kress Ji Cropper, 1966; Anderson, 
Faust ^ Rodenick, 1968), very specific questions during learning (Watts 
^ Andersoji, 1971) and placing questions before rather than after relevant 
material (Frasc, 19o7; Rothkoph Bisibicos, 1966) also square with this 
interpretation. 

Anotlier problem-solving study (Mayer it Grceno, 1972) attempted to 
vary sequencing in a programmed text for the concept of binomial probability 
(i.e., the probability of obtaining R successes in N Bernouli trials) in 
the following manner: (1) Group G Ss '*began by learning about component 
variables of the formula (e.g., the concepts of 'trial,' 'success,' 
'probability of success,' etc.) and gradually learned to put thorn together^' 
while, (2) Group V Ss "were first introduced to the complete formula and 
then gradually learned how the component variables figured in using the 
formula" (p, loo) . 
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Altiiougii the Maycr-tirccno instructional methods fail to fit the 
inductive-deductive classifications as well as previous studies, it seems 
that the Group V rule-to-application sequence and the Group C application- 
to-rule sequence reflect overall deductive and inductive teacliin^ strategies, 
respectively. Summarized in Table 12 are the typical results of a sub- 
sequent transfer test composed of problems requiring a direct '^plug-in" 
into the fariaula rule (Type F) , problems requiring a minor algebraic trans- 
formation before ^'plugging in'* (Type T) , problems that were not answerable 
(Type U), and questions about the formula (Type Q) • 

TAiiLh i: 

Proportion Correct by Question Type 
for Two Instructional Groups 
(Data from Mayer and Greeno, 1972) 

Type F 'i'ype T lype U Type Q 
Group F .75 .57 ,43 ,43 

Group G .^8 .40 .65 .83 

Significant interactions in transfer performance like that above 
were found in three cases suggesting that the two instructional methods 
produced '^structurally different learning outcomes" one supporting 
good near transfer but poor far transfer and one supporting poor near 
transfer but good far transfer. This interaction was essentially eliminated 
when Ss in both groups were required to answer many questions during learning, 
tlius suggesting that: "by having subjects in both groups focus their attention 
on finding the answers to specific questions, apparently there was such 
siiiularity in their mathemagenic (Rothkopf, 1970) behavior tliat the dif- 
leienccs in sequence" of presentation failed to produce a substantial dif- 
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ference in learning outcome" (p. 173). 

Apparently, the type of task may influence tlic effects of sequencing. 
In the Worthen, Guthrie and Roughead and Scandura experiments, deductive 
Ss excelled in learning ease but inductive Ss excelled in near and far 
transfer; but in the Mayer and Greene study deductive Ss excelled on near 
transfer and inductive Ss excelled on far transfer. In other v/ords, on 
some tasks, where only one specific complex rule or algorithiU is learned, 
deductive training may result in superior near transfer (i.e,, direct 
application of the rule) as well as initial learning case, 

Hvifirj.cf* for the advantage of dedu^^iive instruction cn ease of 
initial learning and on use of specific rule application procedures (near 
transfer) is complemented by a recent study (Dcno, Jenkins, 5 Massey, 1971) 
in which Ss learned to classify LKG patterns by two methods, (1) The 
"deductive" group was given an explanation of the classification rules 
followed by representative examples for S^ to classify to a criterion of 
five in a row, while (2) the "inductive" group was given representative 
examples for S to classify to a criterion of five in a rov\' followed by, 
it was assumed, S^'s understanding of the rule. 

On a subsequent transfer test using 30 photocopies of actual liKG 
patterns, deductive S^s correctly classified signific^mtly more patterns 
(22, y on the average) than inductive Ss (19,1 on tl\e average). The xiuthors 
concluded that deductive training better prepares S_ to apply a standard 
classification rule in a complex situation. Performance on more remote 
transfer tasks was not assessed. 

The importance of the general rule or principle and its role in £'s 
encoding of r.iiitcrial is l)i^;hligiitod inasericr^ of studi cs by Katonc^ (rJ42b) in 
wliich lie varJcd the prcseiiCation order of A-toxts wl»M:i) oxpj.dnotl a |;ivcn 
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rule or principle (e.g., in tlic figure 




, angle A + angle B + 



angle X = ISU degrees) and B-texts whicli presented some facts for to 
remember (e.g., the dimensions of a plot of real estate shaped | j ). 




The results indicate that it is often easier to remember the facts in 
the B-text if the A-text precedes it rather than follows. In tliis case, 
as in the iiKG classification study, pre-fami liarii:ation with the rule 
provided an economical organizing principle for tlie required task. 
Apparently, if application of the stated rule is the objective, deduc^-ive 
instruction is most effective; and if more sophisticated transfer is 
the objective, ir.ductive instruction is superior. 



plications or examples of a yet unstated definition or principle followed 
by the discovery and statement of the definition or principle'*) and de- 
ductive ("statement of rule or definition followed by examples or applica- 
tions") programs yielded significantly different imjuediate retention per- 
formance in favor of the deductive group but failed to find significant 
differences in the ability to transfer the learned concepts (Belcastro, 
1966). Although this study replicates the finding of an advantage in ease 
of learning for deductive Ss , it is difficult to interpret the transfer 
data due to a failure of the two groups to reach equal levels of initial 
learning. 



which geometry concepts (quadrilateral, parallelogram, trapezoid, and 
rhombus) were taught to sixth graders by two different kinds of written 
lessons, (1) The "discovery" method was inductive in that questions about 
definitions or defining properties were asked afte r each example set, 
while (2) the "expository" method fits the deductive classification because 



In another stud/ an attempt to teach algebra by inductive ("ap- 



Similarly, Nelson and Frayer (1972) have reported a study in 



so 



/ 



statements of definition or defining properties came before representa- 



tive figures. 

For example, "discovery" Ss received a figure followed by a line 
of questioning. "Look at this figure. Measure side AB. Measure side AC. 
IVnat do you find? ilow is this like the figure in the last question?" In the 
"expository" lessions, on tJie otlier hand, eacli exainple was preceded by 
statements such as: "Look at this figure. This figure is a trapezoid. 
Note that side AB is parallel to side AC." 



superiority of expository over discovexy group performance on immediate, 
1-day, and 21-day retention and both groups performed significantly better 
than a control group which received no relevant instructions, A repeated 
measure analysis of data summarized in Table 13 yielded a significant change in 
performance between tlie group.s over the retention interval; however, it 
must be noted that, again, on both tests expository £s scored higher. In 
addition. Nelson and Prayer reported that, on the average, expository Ss 
took 15 minutes to learn as compared with 50 minutes for discovery Ss. 



Using independent groups. Nelson and Prayer found an overall 



TABLL 13 



Average Number Correct on Retention Tests 



for Two Instructional Groups and Control Group 



(Data from Nelson and Prayer, 1972) 



1-IJay 
Retention 'lest 



Retention Test 



21-.Uay 



lixpository 



18.2 



15-8 



Discovery 



14.7 



IS.O 



Coiitrci 



11. S 



12.1 



SI 



Two problems with generalizing these advantages of deductive 
training is that no criterion of initial learning was enforced and no 
transfer test was used. Another difficulty is that Scott's (1970) results, 
using the same materials ajid a repeated measures design, directly contra- 
dict tiiese findings. On a test of immediate retention no significant 
differences between the groups was found; however, on a 21-day retention- 
transfer task set> discovery Ss significantly outperformed expository Ss. 
The fact tliat the Nelson-Frayer groups differed on immediate retention 
but the Scott groups did not may be due to differences in criterion 
learning: if this is the case^ the Nelsnn-rraycr findings may be inter- 
preted as reflecting quantitative differences in amount learned wliile 
the Scott findings reflect qualitative differences in encoding. Future 
research incorporating learning criteria and transfer tests as well as 
measures of learning difficulty and retejitipn must resolve this matter, 

A furtlier confirmation of the reported advantage of deductive Ss 
on ease of learning measures is offered by Koran (1971), Subjects were 
taught elementary statistical concepts (e.g., mean, median, normal curve) 
via instructional programs that either (1) presented rule frames (stating 
definitions or principles) before example frames (offering application 
opportunities for S) , or (2) presented example frames before rule frames. 
Although the difference in average learning time (81. S minutes for deductive 
Ss ana 82.9 minutes for inductive Ss) did not reacli statistically significant 
levels, deductive Ss made significantly fewer errors (an average of 10.4) 
than inductive Ss (an average of 13.8) during learning.' 

On a test given two weeks later that involved both retention (asking 
S to state previously lourncd rules or concepts from cues) and transfer 
(asking S^ to apply tlicm to previously unencountered problems), there was not 
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a significant difference between the groups. However, since Koran failed 
to separate performance from transfer performance, there is no way of 
testing the proposition that deductive Ss excell on retention and inductive 
Ss excell on transfer. 

A more serious non-confirmation of differences between instructional 
methods comes from an experiment on teaching physics concepts (e.g., 
inertia, mass, weight, force, and moment of inertia) conducted by Maltzman, 
iiisman and Brooks (19S6). The "traditional" method of instruction, fol- 
lowing a deducfive tack, presented S with a physics text followed by an 
illusvratiori of the moracnt of inertia co.^ucpt using a torsion pendulum 
(li^ demonstrated that the pendulum moved faster when weights were closer 
to the center of gravity); the "modern" method, following an inductive 
sequencing, presented with the torsion pendulum as a problem (E^ asked 
S to figure out how weight placement related to speed of swing) followed 
by the physics text. 

On a retention test of the material in the text, there was no 
significant difference between the groups. On a transfer task was asked 
to solve the "two-sphere" problem: given two spheres of equal weight and 
size but made of different metals such that one is solid and one is hoJlow, 
how can they be differentiated without using any special equipment or damage. 
The correct answer, obtainable from the text concepts, is that they would 
roll at different rates down a slope and was given equally often by Ss 
in both groups (50% for each) , 

In comparison with previous studies, Maltzman et aj^. 's experiment 
employed an entirely different subject area and more conventional material. 
As Koran (VJll) has ])ointed out, there is some support (Krumboltz Yabroff, 
196S; Wolfe, 1963) for the notion that sequencing has its greatest influence 
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on teaching •'puzzle-type** tasks, and the method is less important for 
conventional text- lecture materials. The presentation of tiiis possibility, 
however, is not accompanied by any tlieoretical explanation; nor is it 
clear that the fact has been established. For example, in an earlier 
study using basically the same procedure as Maltzman ^ al_. , Szekeiy 
(1950) found the "modern*' method Ss performed significantly better than 
"traditional" method Ss on the two-sphere problem (an average of bS% and 
20% correct soluuicns, respectively). 

In sununary, due to the fairly small, Iiard to interpret, and not 
completely consistent experimental data base concernin^^ rule-bnsed 
material, any generalizations about the effects of deductive vs. inductive 
methods on learning ease, retention and transfer remain to be tested. 
The present level of research findings does suggest that the following 
generalizations, based on type of material taught, should be among those 
given careful consideration; (1) For teaching a set of simple solution 
rules, all related to a sort of general or intuitive problem solving 
strategy (e.g., Guthrie's cryptograms), deductive methods result in 
superior learning ease and retention but inductive methods result in 
superior near and far transfer. (2) For teaching a single, complex, non- 
intuitive algoritlim (e.g., Ueno et^£l_-'s UKG pattern classes), deductive 
methods result in superior learning ease, retention and near transfer but 
inductive methods result in superior far transfer. 

A -careful analysis of internal activity during Ic^irning siiuald 
test the propositions that: (1) Deductive Ss, being given the to-be- learned 
rule, see their task as being able to aj^ply the rule to examples like those 
shown and thus or»codo ihc rule within a fairly narrow cognitive set ouipha- 
sizing mechanical operations, (2) inductive S^s see their task as being 
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able to generate rules lor various examples, and hence encode the material 
into a broader cognitive set empiiasizing the general properties of the 
concepts involved. 

Some information about the effect of encouraging S to encode the 
to-be- learned concepts more broadly is provided by a recent study (Gagn6 
<i Bassler, 1965) demonstrating that sixth graders who learned geometry 
concepts accompanied by a narrow range of examples performed significantly 
worse on long-term retention than Ss receiving no examples beyond those 
in the program. Apparently, the presentation of a narrow range of examples, 
although giving Ss more practice, either encouraged Ss to encode in a 
different or in a weaker way than other Ss. 

Structuring of direction, internal activ i ty and performance : A third 
dimension of instructional methodology also involves sequencing. But 
rather than investigating the effects of placing a statement of the to- 
be-iearned rule before or after representative examples, this dimension 
deals with how the rule or i:oncept is explained in a smooth, systematic, 
hierarchical manner eliciting few errors during learning (as proposed by 
Skinner, 1958, 1965; Cagnd, 1S62, 1963, 1968) or in a discontinuous, 
unstructured manner eliciting far more errors (as proposed by Pressy, 
1967; Bruner, 1963). Skinner (1958, p. 974), representing the traditional 
reinforcement theory or '^programmed learning" position, offers the to-be- 
tested proposition as follows: "...facts, terms, laws, principles, and 
cases ... must then be arranged in a plausible developmental order....*' 

Many of the studies dealing with systematic or error-minimization 
methods vs. discontinuous or error-elicitation methods have developed 
out of tlie context of programnicd, tOciching machine and, more recently, 
computer assisted instruction. J)uc to the enormous breadth of this area 

O 
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and its traditional emphasis on verbal, text-type learning and retortion 
(Skinner, 1958), the present review will be limited to one well-tested 
instructional variable and its relation to principle-based or problem 
solving material. A major test of the structured-unstructured question 
(or as some have put it, tlie small step - large stcj) question) has taken 
the form of "scramble studies"; experiments dealing with the effect of 
randomizing tlie presentation order of some unit (e.g., frames, paragraphs, 
etc,) of the instructional material, hence increasing the difference 
among adjacent units and the ^jossibility of subject error. 

An early study by Roe, Case and Roe (1962) using a "^,uided dis- 
cover/" type program for teacjiing statiiiLicb revealed no significant 
difference in errors in learning or post-test retention- transfer per- 
formance between scrambled and normal order groups. This finding was 
replicated by Levin and liaker (1963) using a geometry program (e.g., 
dots, lines, angles, triangles) for second graders; there were no sig- 
nificant differences in median errors to learn, time to learn, retention 
or transfer among Ss who received the 180-frame progrrn in normal order 
and those wlio received the prograjn wjtli tlie 60-frame "angle" section 
deemed tiie hardest in scrambled order. 

Payne, Krathwihl and Gordon (1967) used a revised version of the 
Krumboltz-IVeismun (1962) program to teach concepts of educational measure- 
ment which contained three sections (percentile norins, z-scorcs, and 
validity) of 45 to 60 frames each, liigiit experimenlal groups representing 
all combinations of logical and scrambled ordering of the three sections 
did not significantly differ in tests of immediate retention nor two-week 
retention. 

These tlircc studies, revealing no difference in Ictirninj'. difficulty 
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and retention-transfer, have been criticized often by their own authors 
for using "non-scqucntial" material. An example (Levin § Baker, 1963) is 
given below: 

22. Is this r.n angle? 




23. L)o CU and i)E make an angle? 




24. How many straight lines in this angle? 

V 

25, ^5 this a;: anRlo? 
P 
i< 

Holland (1967, p. 69), in a brief review of these studies, noted: ''program 
error rate for the two sequence forms did not differ, suggesting that the 
items were not highly interdependent even in the 'sequenced' case, eitl^er 
because of the nature of the concepts taught or because of ovcrcueing/' 
In terms of learner activity, it seems plausible that subjects in the 
various sequence groups were not performing different cognitive tasks, 
and hence, with similar ^^set'* and "content*' conditions, learned tlie same 
thing. Unfortunately, there is no direct test of this admittedly post- 
hoc suggestion, although it has been found that more highly sequential 
material does often produce differences in error rate. 

Niedei^mcyer (1968) reported a study by Wodtke, Brown, Sands and 
Fredericks (1967) in which two types of material a sequential program 
for number bases and a non-seqinential program about the human ear — were 
taught and tested on a retention-application test. For the non-sequential 
material, as with the above eX[Ujrimcnts , scrambling iiad no effect on 
learning errors nor ])Ost-tc:St perfor:nanco; however, scrambling; did sig- 




57 



nificantly increase learning time and errors for sequential material. 
This latter difference in learning difficulty implies a possible dif- 
ference in subject activity during learning, however, Wodtke ct aj^. 
report no differences among the scrambled and normal groups on post -test 
performance. It appears that either the post-test was insensitive to 
learning outcome differences, or tliat the type of differences in cognitive 
activity in learning scrambled vs. unscrambled material is not the same 
as nor as important as "search and selection" differences between minimum 
or method direction Ss vs. answer direction Ss or inductive vs. deductive 

c - 

For example, Wodkte et^ al^. argued that scrambling may be an "over- 
rated variable" and tiiat "...adult S^s are able to relate relevant informa- 
tion as it is made available....". In other words, although it may be harder 
for scrambled £s to find the to-be- learned content, once found it is 
assimilated to the same cognitive set as for unscrambled S^s. The dif- 
ference between this kind of "suaxch and selection" and that described in 
previous sections may be that the present type involves searching tlirougli 
content material holding parts in rote memory and organizing it — 
while the other involves searching through existing cognitive structures. 

A similar finding is reported by Neidermeyer, Brown and Sultzer 
(1909) using "highly interdependent" material in the form of the Gagn6- 
.Hrown (IDOl) number series frames. Groups received the fraiu3S in logical, 
scrambled and reverse orders and were tested on retention (10 of the 
original concepts), and transfer (10 problems in which S had to derive 
series sum formulae). An analysis of the results, shown in Table 14, re- 
veals that only the differences in looming errors is statistically, 
significant. 
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TAiiLii 14 

Performance on Learning, Retention and Transfer 

for Three Instructional Groups 
(Data from Ncidermcyer, Brown and Sultzer, 1^69) 

Learning Retention Transfer 



Average Time Average iirror*; Average Number Average Number 
(min . ) Correct Correct 

Logical 78.5 38,2 3.3 3.0 

Scrambled 80.9 54.8 1.8 3.0 

Reverse 81.5 52.1 2.6 2.1 

Jones and Hick (1969); in a program for teaching addition facts 
to eighth graders, also failed to find any differences between logica] 
and scrambled orderings on a subsequent 20-item test of applications. 
These findings were summarized by Jones and Hick (p. 69) as follows: 
"Sequencing programmed instruction in accordance with Skinner's view 
that small step size is best produced essentially the same performance 
as the Bruner«Pressey notion, that large variation in step size is best.*' 
One factor limiting the generality of these latter throe findings, 
as well as the other studies in this area, is the short length of the 
training session. As Nicdermeyer ££.£l^«(P' 65) pointed out: "...the 
present study, as well as previous studies lead the authors to believe 
that for short (less than two hours) programs, sequence may not be as 
crucial to cognitive outcomes as has previously been thought.** it seems 
obvious but still untested that scrambling larger amounts of material 
would overtax ^ to the point of yielding inferior retention-transfer per- 
formance; however, it seems that S^'s performance would more reflect 
less learning, tiwin a different kino^ of leajning. 
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Some information about the intellectual requirements of learning 
scrambled sequences what Payne ^ ^^^^^^ ^^^^ '*f lexibility 
and adaptability of tlie college student** comes from a study by Buck- 
land (1968) involving a SC-frame program for teaching base 5 to base 10 
conversion to elementary school children. For high ability Ss there \>iere, 
as in some of the previously cited studies, no significant differences 
between standard and scrambled groups in learning .time, learning errors, 
retention (tests of base 5 to base 10 conversion problems) or transfer 
(tests of conversions from new number bases). However, for low ability 
Ss, presKii.ably Jess ab]« to search and "rg^-nize the scratr.bled materi'^l, 
more Icai^ning errors and lower retention- transfer performance characterized 
the scrambled groups. Apparently, like many of the "minimum direction" Ss, 
low ability scrambled £s simply fail to come in contact with the to«be- 
learned concepts. 

Another instance of inferior performance by scrambled Ss comes 
from a stuHy by Roc (ly62) which, using a longer version of the Roe et^ 
al . (li:^02) statistics program, found Ss receiving ordered instruction made 
fewer errors and took less time in learning, and performed significantly 
better on post-test measures of retention-transfer. Leaving aside Roe's 
dubious explanation of why the shorter version failed to produce equivalent 
results, the strength of these longer version results has been questioned. 
Niedermeyer (1958, p. 304) notes: significant difference' for posttest 

scores turns out to be only ten percentage points. . .which on the 14-item 
test he used, is a difference of only one and one-half items. . .while these 
differences are statistically different, one wonders whether the magnitude 
of these differences is large enough to consider the issue closed.*' 

A more striking instance of inferior performance due to scrambling 
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comes from a study by brown (1970) which used a version of the Gagn6- 
Brown (1901) series sum program. In an apparent contradiction to the 
earlier Niedcriricyer et al . study, scrambled Ss scored significantly worse 
than logical Ss on lacasurcs of learning ease (errors and time) and trans- 
fer (generating fox'ir.ulae for new series sum problems), as shown in Table IS, 

TABLE IS 

Performance on Learning, Retention and Transfer 
for Two InstiTictional Groups 
(Data from Brown, 1970) 



Learning Retention Transfer 

Average Average. Average Number Average Number 

Time Errors Correct Correct 

Logical 64, S 7.2 18.5 4.9 

Scrambled 80.5 11.8 17.2 3.2 



As witli the Roe study, the entire claim to inferior learning outcome 
performance relies on an average difference of about l.S items on a 
transfer test; further studies with larger transfer tests would certainly 
be useful in donionstrating the fact. 

Some evidence for the importance of S^'s ability to impose a 
structure on incomini^ material an ability which is seriously taxed by 
scrajiibled presentation order was provided by Merrill and Stolurow 
(1965). Using a ^^programmfjd problem solving presentation of an imaginary 
scier.cc*' made up of a ''Xenograde system*' containing ''satellites,'* 
"velocities,** and *'blips,*' Merrill and Stolurow found that presenting 
£ with an advance sujiunary of the five to-be- learned principles stated in 
hierarciiical order si.|\'uf leant iy reduced the number of learning errors 
and increased tranr:;:ccr perforinance. Apparently, the advance organizer 
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helped S find the required "content*' more efficiently; however, since 
Merrill and Stolurow failed to enforce an equal learning criterion 
across all groups, it seems likely that the performance differences re- 
flect differences in amount learned. 

In summary, of the nine studies reviewed, three found no significant 
differences in learning difficulty or outcome performance, three found 
significant differences in learning difficulty only, and three found sig- 
nificant differences in learning difficulty and outcome performance for 
logical vs. scrambled presentation of mathematical problem-oriented 
•natericil, based on this box score the -^w/llowing prcpositionc deserve 
attention: (1) Scrambling increases (especially for difficult, sequential 
material or low ability Ss) or has no effect on learning difficulty, and 
has no effect or hurts transfer-retention performance. (2) Ordered 
presentation decreases or has no effect on learning difficulty and has 
no effect or helps retention- transfer performance. 

When the internal cognitive activity of is considered, the 
follov/ing propositions should be tested: (1) Scrambling requires S_ to 
search and organize the content material, a relatively low level mechanical 
process which seems to add overall learning difficulty and sometimes 
surpasses S^'s intellectual ability. However, the search process is basically 
a mechanical one that does not greatly influence S^'s "set'' (as does the 
search of existing knowledge required of minimum-intermediate direction 
or inductive Ss); hence if S^ does find the required "content" the learning 
outcome will be essentially similar to Ss in the ordered condition, and 
if not, it will be quantitatively less. (2) Ordered presentation simply 
makes access to the required "content" easier but does not influence S's 
set. Two factors influencing the importance of scrambling (both related 
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to ability to bridge the scrambling gap) seem to be the type of 
material both the degree of independence across frames and the 
difficulty and learner characteristics and capabilities. 

Apparently, Glaser's (1966) claiw that the amount of subject error 
during learning represents an important instructional method variable 
must be amended to allow for distinctions between ei^rors due to search 
for content material and errors due to search of existing cognitive 
structures, ivliereas the former seems to result in quantitative differences 
in learning outcomes (e.g., normal order Ss often learn more than scrambled 
S3), the la'i:u*-r see^ns to result in qualitr^tive differi-nces (f*.s > inter- 
mediate direction Ss vs. maximum direction Ss) . Since all of the scramble 
studies used ''guided discovery'* type direction (thus encouraging an active 
"set") it appears that any differences in leai'ning outcome can be attri- 
buted to diffei'ences in the amount of content discovered. 

Other important questions about the role of subject responses 
during learning, though only partial indicators of internal activity, 
have been tested almost exclusively using verljal-text material, and offer 
informative research routes for testing many of the propositions put 
forth with regard to learning to solve problems. The main questions are: 
(1) What is the influence of overt vs. covert responding to interspersed 
questions? (2) What is the influence of placing review questions before 
or after relevant instruction? (3) l^Tlat is the influence of the number 
of alternatives or the amount of prompting for interspersed review questions? 
(4) What is the effect of timing, type and amount of feedback? 
Control of direction, internal activity and performance : The fourth 
dimension is the degree of learner vs. experimenter (or tcricher) control 
of the rate and order of presentation, Althougii a nunibcr of experimental 
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attempts to deal with this problem in problem solving contexts deserve 
mention (e.g., Lewis 5 Pask, 1965; Evans, 1965; Kress fi. Cropper, 1966; 
Coop ^ Brown, 1970) and the theoretical importance of this issue has been 
discussed (Bruner, 1961), there is an Insufficient literature of laboratory 
problem-solving studies at this time. One of the motivations for such 
studies is an opportunity to more closely investigate the relation between 
learner activity (and by inference, internal activity) and learning outcomes. 

The Unconclusio ii 

The future of the instructional method problem is unclear. It 
is Clear, nowever, that little progress will be made until the suffocating 
emphasis on ^Vhich metliod is best'* gives way to an attempt to define and 
relate to one another, external features of instruction, internal features 
of subject character and activity during learning, and outcome performance 
variables. 

This review seems to indicate that the most developed findings 
to date deal with the dimension of amount and type of direction, with the 
dimensions of sequencing and of structuring less well investigated, and 
the dimension of control fairly unstudied. 

In the flow chart given in Fig. 1, a simplified model of the en- 
coding process is given. The two conditional branches represent Ss ability 
to come into contact with the to-be-learned content and the breadth of £'s 
assimilative set . In essence, the determination of how instructional 
variables affect these two conditional processes (and hence the learning 
outcome) is tJie future challenge of the instructional method problem. 
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Fig. 1. Flow chart showing hypothetical encoding processes of learning. 
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